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The dopamine-dependent plasticity of the cortico-striatal synapses is considered as 
the cellular mechanism crucial for reinforcement learning. The dopaminergic inputs and 
the calcium responses affect the synaptic plasticity by way of the signaling cascades 
within the synaptic spines. The calcium concentration within synaptic spines, however, 
is dependent on multiple factors including the calcium influx through ionotropic glutamate 
receptors, the intracellular calcium release by activation of metabotropic glutamate 
receptors, and the opening of calcium channels by EPSPs and back-propagating action 
potentials. Furthermore, dopamine is known to modulate the efficacies of NMDA 
receptors, some of the calcium channels, and sodium and potassium channels that affect 
the back propagation of action potentials. Here we construct an electric compartment 
model of the striatal medium spiny neuron with a realistic morphology and predict the 
calcium responses in the synaptic spines with variable timings of the glutamatergic and 
dopaminergic inputs and the postsynaptic action potentials. The model was validated 
by reproducing the responses to current inputs and could predict the electric and 
calcium responses to glutamatergic inputs and back-propagating action potential in 
the proximal and distal synaptic spines during up- and down-states. We investigated 
the calcium responses by systematically varying the timings of the glutamatergic 
and dopaminergic inputs relative to the action potential and found that the calcium 
response and the subsequent synaptic potentiation is maximal when the dopamine input 
precedes glutamate input and action potential. The prediction is not consistent with the 
hypothesis that the dopamine input provides the reward prediction error for reinforcement 
learning. The finding suggests that there is an unknown learning mechanisms at the 
network level or an unknown cellular mechanism for calcium dynamics and signaling 
cascades. 

Keywords: striatal medium spiny neuron, calcium signaling, spike-timing-dependent plasticity, dopamine 
modulation, multi-compartment model 
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1. INTRODUCTION 

The striatum is the input region of the basal ganglia and receives 
glutamate input from the cortex and dopaminergic input from 
the midbrain (Smith and Bolam, 1990). The plasticity of the the 
cortico-striatal synapses is affected by the timing between the 
presynaptic dopamine inputs, presynaptic (cortical) glutamater- 
gic inputs and the postsynaptic (striatal) action potentials, which 
is known as the spike-timing-dependent plasticity (STDP) (Fino 
et al, 2005; Pawlak and Kerr, 2008; Shen et al, 2008). Among 
these, the dopamine input is regarded as the reward prediction 
error and plays a critical role in the reinforcement learning the- 
ory in the basal ganglia (Reynolds et al, 2001; Doya, 2002). 
While the learning theory predicts that the dopamine input fol- 
lowing the spike output induces plasticity, the effect of timing 
of dopamine input on STDP is still unknown. The dopamine- 
dependent plasticity can be mediated directly by activation of 



the intracellular signaling cascades within the synaptic spines 
and indirectly by the modulation of the synaptic receptors and 
the membrane currents that affect the calcium influx to synap- 
tic spines. We previously proposed a computational model of 
the intracellular signaling cascades and showed that the direc- 
tion and the strength of the plasticity are determined by the 
amplitude and relative timing between the dopamine input and 
calcium concentration within the synaptic spines (Nakano et al, 
2010). 

The calcium concentration has intrinsically complex dynam- 
ics and is dependent on multiple factors including the calcium 
influx through ionotropic glutamate receptors, the intracellular 
calcium release by activation of metabotropic glutamate recep- 
tors, and the opening of calcium channels by EPSPs and back 
propagating action potentials. Furthermore, dopamine is known 
to modulate the efficacies of NMDA receptors, some types of the 
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FIGURE 1 | Morphology of a medium spiny neuron expressing Dl-type 
dopamine receptors. Top: A medium spiny neuron filled with the 
fluorescent dye Alexa 488 and observed using a DSL) confocal microscope. 
Bottom: Morphological data imported into the NEURON simulator. The 
arrow heads indicate the proximal and distal dendrites described in 
Section 2.1. 



calcium channels, and sodium and potassium channels that affect 
the back propagation of action potentials. Accordingly, the striatal 
synaptic plasticity is known to be modulated by the spontaneous 
oscillations of the postsynaptic membrane potential between the 
up-state and down-state (Charpier and Deniau, 1997) and by the 
location of the synapse on the dendrite (Kampa et al., 2007). Here 
we have constructed a morphologically realistic electric compart- 
ment model of the striatal medium spiny neuron and we predict 
the calcium responses in the synaptic spines with variable timings 
of the glutamatergic and dopaminergic inputs and the postsynap- 
tic action potentials. The model is based upon our own imaging 
and 3D reconstruction of medium spiny neurons and upon pre- 
vious models of ionic and synaptic currents, calcium dynamics, 
and their dopaminergic modulation. We investigated the calcium 
responses in the proximal and distal synaptic spines during up- 
and down-states under various timing parameters for glutamate, 
dopamine, and postsynaptic action potentials using numerical 
simulations. 

This paper is organized as follows: In Section 2, we present 
the specification of the model constructed for this study. In 
Section 3, we demonstrate that the model well reproduces electro- 
physiological properties reported in the literature, to support the 
validity of the model. Subsequently, we predict the intracellular 
calcium responses to various timing of the triplet inputs: presy- 
naptic glutamate and dopamine inputs, and a postsynaptic spike. 
Herein, we show the distribution of the calcium sources to clar- 
ify which factors predominantly contribute to calcium responses. 
Finally, we summarize the main findings of this study and dis- 
cuss their relationship with the corticostriatal synaptic plasticity 
in Section 4. 

2. METHODS 

2.1. MORPHOLOGICAL MODELING 

An electric compartment model was constructed using realis- 
tic morphology based on measurements from actual medium 
spiny neurons. This allowed us to precisely evaluate the effects 
of back-propagating action potentials. To obtain morphologi- 
cal images, acute corticostriatal slices (300 |xm thickness) were 
prepared from p21-25 Drdla eGFP Swiss Webster mice (Gong 
et al, 2003). A neuron was filled with biocytin through a 
patch pipette and tagged with Alexa 488. A 3D morphological 
image (Figure 1) was obtained using the Neurolucida neuronal 
tracing system with a DSU confocal microscope. Cell mor- 
phology was manually traced using Neurolucida. The traced 
data included information regarding the lengths and diameters 
of the dendrites (Hines and Carnevale, 2001), and were con- 
verted to NEURON hoc files using NLMorphologyViewer and 
NLMorphologyConverter software 1 . In this process, all spines 
were ignored. 

To measure calcium transients in different spines, two spines 
of diameter 1 |xm and length 1.273 |xm (i.e., volume of 1 |xm 3 ) 
were attached to the proximal and distal dendrites (see arrows in 
Figure 1), which were located on 25 |xm and 100 |xm away from 
the soma, respectively. 



http://www.neuronland.org 



2.2. MULTI-COMPARTMENT MODEL 

The electric properties of the neuron was approximated by 
splitting the dendrites into small compartments. The mem- 
brane potential of the jth compartment, denoted by Vj, was 
represented as: 

dVj _ 

Q ~ ~ ^leak, j ~ -^chan, j ~ hyn, j ~ htim, j 

+gj- 1, j {Vj-!- Vj) - gj j+ , (Vj - V j+ ,) . (1) 

Here, ii ea k, j = gleak, j(Yj — £leak) is a leak current through passive 
channels of the jth compartment, gi ea k, j is passive transmem- 
brane conductance, and £i ea k is the passive reversal potential, 
^chan, j and J syn? j are ionic currents through active channels and 
synaptic channels in the jth compartment, respectively (See the 
details in Section 2.3). I s tim, j is a current induced by exter- 
nal stimuli (e.g., current injection in whole-cell patch clamp 
experiments in Section 3.1). The last two terms in Equation (1) 
are membrane currents from neighboring compartments con- 
nected by coupling conductance gj-ij and g/j+i, respectively. 
The coupling conductance gj,j+i is calculated as l/gjj+i = 
2lj/(g a 7tdj) + 2lj+i/(g a Ttdj +1 ), where dj and lj are the diam- 
eter and length of j th compartment. Spatial discretization 
of the model neurons was completed automatically according 
to the d_lambda rule implemented in the NEURON simula- 
tor (Hines and Carnevale, 2001). The neuron is decided to 156 
compartments. 

The effects of the spines ignored in the morphological mod- 
eling were mimicked by locally adjusting the conductance per 
area gi ea k, j and the capacitance per area Cj based on the area 
ratio of the membrane surfaces between the dendrites and the 
spines (Holmes, 1989; Koch, 1998). More specifically, we let 
Fj be defined as Fj = 1 + A sp i ne , j/Ad en d, j> where Ad en d, j and 
^spine, j are the membrane surface area of the dendrites and 
the spines in the jth compartment, respectively. We set gi ea k, j = 
gleakFj and Cj = CFj, where gi ea k and C is the passive transmem- 
brane conductance and the membrance capacitance averaged over 
the whole neuron, respectively 2 . The parameters used for the 
multi- compartment model are shown in Table 1. 



2 In other words, we assumed that the spines had the same channel density as 
the dendrites. 



Frontiers in Computational Neuroscience 



www.frontiersin.org 



September 2013 | Volume 7 | Article 119 | 2 



Nakano et al. 



Striatal calcium response to timed-inputs 



Table 1 | Parameters of compartmodel. 





Membrane capacitance 


1 cm ^ 


S'leak 


Passive transmembrane conductance 


1.7e-5 Scm -2 


tleak 


Leak reversal potential 


— /u m v 


9a 


Axial conductance 


0.01 Scm 


Fj 


Area ratio of dendrites over spines 






if j is a proximal component 


1 




if j is a middle component 


1.3 




if j is a distal component 


3 



Tftese values were based on Wolf et al. (2005). 



2.3. IONIC AND SYNAPTIC CURRENTS 

The ionic and synaptic currents were modeled based on (Wolf 
et al., 2005; Moyer et al., 2007). In this section, we briefly review 
the original model and clarify our modifications. 

The model included the following ionic channels: fast (NaF) 
and persistent (NaP) sodium channels; inwardly rectifying (KIR), 
slow A- type (KAs), fast A- type (KAf), 4-AP resistant persistent 
(KRP), small conductance calcium-dependent (SK) and large- 
conductance calcium- dependent (BK) potassium channels; N- 
(CaN), Q- (CaQ), R- (CaR), L-type Cav 1.2 (Cavl.2), L-type 
Cav 1.3 (Cav 1.3), and T- (CaT) calcium channels (Catterall, 
2000). For each compartment, the total current through the ionic 
channels was given by 



summarizes the activation and inactivation states of the chan- 
nel z given by the Hodgkin-Huxley formulation [See the detail 
in Supplementary Material of (Moyer et al, 2007)]. 

The current through each type z of calcium channel, was given 
by the Goldman-Hodgkin-Katz (GHK) current formulation: 

= 4F 2 V [Ca 2 +]j - [Ca 2 +] 0 exp{-2FV7(£r)} 
z z RT 1 - exp{-2FV/(RT)} 

where the gas constant, Faraday constant, and the tempera- 
ture were set to R = 8.31 J/mol/K, F = 96489 C/mol, and T = 
303. 15K (equivalently, 30°C), respectively. [Ca 2+ ]i and [Ca 2+ ] G 
are the concentrations of intracellular and extracellular calciums, 
respectively. [Ca 2+ ] G was constant at 5mM, while [Ca 2+ h varied 
over time t (Section 2.4). P z is the calcium permeability of the 
channel z, given by 

P z =p z x z (t,V), (5) 

where p z is the maximum permeability and x z (t, V) has the same 
meaning as Equation (3). 

The model also included AMPA-type glutamate receptors 
(AMPARs) and NMDA-type glutamate receptors (NMDARs). For 
each compartment, the total postsynaptic current through the 
receptors, denoted by J syn , was given by 

hyn = ^AMPA^AMPA + NMDA^NMDA > (6) 



^chan = ^NaChan + ^KChan + ^CaChan (2a) 
^NaChan = M^NaF^NaF + ^NaP^NaP (2b) 
^KChan = I^KIR^KIR + I^KAs^KAs + I^KAf^KAf 

+ ^KRP&RP + I^SK^SK + ^BK^BK (2c) 
fciChan = ^CaNfcaN + ^CaQ^CaQ + ^CaR^CaR 

+ ^CaJcaT + ^Cavl.2^Cavl.2 + ^Cavl.3^Cavl.3» (2d) 

where the index of the compartment, j, is omitted for notational 
simplicity 3 . /NaChan, fehan, and IcaChan are the currents summed 
over sodium, potassium, and calcium channels, respectively. The 
coefficient \i z for each channel-type z is the dopamine modula- 
tion factor, and the details are described in Section 2.5. For the 
moment, we assume that |x z = 1 is fixed for each channel-type z 
so that the dopamine modulation can be ignored for simplicity. 

The current through each type z of sodium and potassium 
channel was given by 

Iz=gzX z (t,V)(V-E Tev ), (3) 

where g z is the maximum conductance of the channel, and -Erev 
is the reversal potential that was set to £ rev = 50 mV for every 
sodium channel and £ rev = — 90 mV for every potassium chan- 
nel. x z (t, V) is the time- and voltage -dependent variable that 



3 The same omission will be made later, as long as the dependence is obvious 
from the context. 



where the current though each receptor z, I z , was given by the 
same form as Equation (3), and the reversal potential was set to 
£ rev = 0 mV for both receptors. 

In our study, the variable x z (t, V) for every z had the same 
dynamics as (Moyer et al., 2007). The only difference was the 
setting of the maximum conductance g z and the maximum per- 
meability p z , and we adjusted these parameters to fit our exper- 
imental data using Neuro fitter (Geit et al, 2007). The resulting 
parameters are listed in Table 2. 

2.4. CALCIUM DYNAMICS 

The model proposed in Wolf et al. (2005); Moyer et al. 
(2007) does not consider calcium release from intracellular cal- 
cium stores [i.e., endoplasmic reticulum (ER)] through ryan- 
odine and inositol- 1,4,5-triphosphate (IP3) channels, which is 
suggested to significantly affect the activity of various neu- 
rons (Falcke et al, 2000; Varona et al, 2001b,a). To precisely 
evaluate the calcium responses in two spines attached to the 
proximal and distal dendrites, we refined the calcium dynam- 
ics model based on De Schutter and Smolen (1998). Figure 2 
shows all the processes contributing to calcium dynamics in our 
model. 

More specifically, the transient change in intracellular calcium 
[Ca 2+ ]i were given by 

d[Ca 2+ ]i 

— /CICR + 7lP 3 — /uptake + /leak + /cur — /pump 

+ ([Ca 2+ ]oo - [Ca 2+ ]i) /t. (7) 
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Table 2 | Parameters for ionic and synaptic currents. 



Channel-type z 


g z (S cm" 2 ) 


Channel-type z 


p z (cm/s) 


NaF 


(s) 


i.yo 


uav i.z 


i.o4e-o 




(p,m,d) 


0.0185 


Cav1.3 


1.7e-6 


NaP 


(s) 


7.36e-5 


CaN 


2.0e-5 




(p,m,d) 


2.86e-7 


CaQ 


1.2e-5 


KAf 


(s,p) 


0.247 


CaR 


5.2e-5 




(m,d) 


0.0429 


CaT 


8.0e-7 


KAs 


(s,p) 


0.0129 








(m,d) 


9.44e-4 


Receptor-type z 


~9z (PS) 


KIR 




4.18e-4 


AM PA 


447 


KRP 




7.3e-3 


NMDA 


226 


BK 




1.58e-3 






SK 




0.0910 







The parameters for NaF, NaF? KAf and KAs channels varied depending on the 
compartment location. Thus, the characters s, p, m and p attached to the 
channel-type stand for the soma, and proximal, middle, and distal dendrites, 
respectively. 




FIGURE 2 | Calcium dynamics. Calcium sources are divided into two 
groups. One group consists of extracellular sources, and includes calcium 
influx from voltage-dependent calcium channels (VDCCs), and from calcium 
permeable ionotropic glutamate receptors (iGluRs). The iGluRs in our model 
consists of AMPARs and NMDARs. Calcium is also pumped out of cells 
into the extracellular matrix by calcium pumps. The other group consists of 
intracellular calcium stores in the endoplasmic reticulum (ER), which are 
accessed by IP3 receptors (IP3RS) and ryanodine receptors (RyRs). IP3 is 
produced by metabotropic glutamate receptors (mGluRs). Calcium uptake 
is mediated by the Sarco/ER Ca 2+ -ATPase (SERCA), and leaks occur 
through the ER. 

Here, /cicr is the flux caused by calcium -induced calcium release 
(CICR) from intracellular stores. This process is mediated by 
ryanodine receptors, and was modeled as 



/cicr = Vcicr 



[Ca^+] 



[Ca 2 +]i + K C icR 



([Ca 2+ ] ER -[Ca 2+ ]i), (8) 



where Vcicr = 3 x 10 -12 s _1 is the maximum rate of CICR and 
^CICR = 0.2 |xM. [Ca 2+ ]£R = 0.20 mM is the calcium concentra- 
tion in the ER. 

/ip 3 is the flux caused by IP3 -induced calcium release from 
intracellular stores. It is known that the process has a bell- shaped 
steady state curve that depends on [Ca 2+ ]i with a sharp peak 
around 0.2 |xM; thus, it was modeled as 



7ip 3 = V 1V3 m 3 h 3 ([Ca 2+ ] ER - [Ca 2+ ]i), 



(9) 



where Vn> 3 = 1 x 10 -9 s _1 is the maximum rate of the IP3- 
induced release, m and h are an activation gate and an inactivation 
gate, respectively. They were given by 



[IP3L 



[Ca 2+ ]i 



[IP 3 ]i + diP3 [Ca 2 +]i + 4ct' 

dinh ([IP 3 ]i + *p 3 ) + [Ca 2+ ]i ([IP 3 ]i + ^dis) ' 



(10) 



(11) 



where dip 3 = 0.13 |xM, d act = 8.2 x 10~ 2 |xM, d^ = 1.05 |xM, 
and ddis — 0.94 |xM are the dissociation constants for IP3 bind- 
ing to the uninhibited receptors, Ca 2+ -activation of the receptors, 
Ca 2+ -inhibition of the receptors, and disinhibition of the Ca 2+ - 
inhibited receptors, respectively. [IP 3 ]i is the level of intracellular 
IP3. It should be noted that IP3 is generated via G-proteins 
when glutamate binds to metabotropic glutamate receptors. The 
transient change in [IP3]i was modeled by 



fl!P 3 ]i 
dt 



= YlP 3 ?Glu exp (-? G luAlP 3 ) - P1P3 ([ IP 3]i - [IP 3 ]min), 



where ?g1u is the time elapsed since the last glutamate release from 
the presynaptic neuron, and tip 3 = 220 ms is the time to peak. 
yjp 3 = 5 x 10 -6 mM/ms 2 determines the maximum rate of IP3 
production, (3ip 3 = 0.2 ms -1 is the removal rate, and [IP3] m in = 
0.24 |xM is the minimum level of [IP3L. 

/uptake is the calcium uptake to the ER, which was modeled as 



[Ca 2 +]f 



/uptake — ^uptake 



Uptake + [Ca 2+ ]?' 



(12) 



where Vuptake — 0.75 x 10 -9 |xM/s is the maximum rate of 
uptake and Uptake = 0.2 |xM is the dissociation constant, 
/leak is the calcium leak from the ER, which was modeled as 



/leak = Vieak([Ca 2+ ] ER - [Ca Z+ ]i) 



(13) 



where Vi ea k = 6.15 x 10 -14 s _1 is the maximum rate of leak. 

/ cur is the calcium current through calcium channels and 
calcium permeable glutamate receptors, and was given by 



/cur — 



JcaChan + ^AMPA^AMPA + ^NMDA^NMDA 
2FV ' 



(14) 



where F = 96489 C/mol is Faraday's constant, v = 1 |xm 3 is 
the volume of the compartment, campa and cnmda are the 
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effectiveness of calcium ions in the synaptic currents through 
AMPARs and NMDAs, respectively. They were set to campa = 
0.0005 ^ampa and campa = 0.01 ^ampa- 

/pump is pumping activity to the outside of the cell, 



In addition to channel conductance, dopamine affects the 
voltage dependence of the activation gating of Cavl.3 ionic chan- 
nels (Moyer et al., 2007). We modeled it in the same manner as 
the conductance modulation 4 . 



/pump — Vpump ^ 2+ 



[Ca 



2+1 



[Ca ]i + -Kp>ump 



(15) 



where Vp ump = 0.1 |xM/ms is the time constant of the pump and 
£pump = 0.1 |xM is the equilibrium calcium value. 

The last term in Equation (7) is a simple diffusion or buffering 
process, in which the parameters were set to the same as (Wolf 
et al, 2005), that is, x = 43 ms and [Ca 2+ ]oo = 0.01 |xM. 

2.5. DOPAMINE MODULATION 

While the effects of dopamine on channel conductance vary in 
different cell types and brain regions (Surmeier et al, 1995; Yang 
and Seamans, 1996; Hernandez-Lopez et al, 1997; Cepeda et al, 
1998; Nicola et al, 2000; Johnson et al, 2003; Surmeier et al, 
2007; Steephen, 2011; Zhou and Antic, 2012), the dopamine 
enhances KIR, Cavl.2 and NMDAR conductances and reduces 
NaF, CaN and CaQ conductances in the striatum, as summarized 
in Moyer et al. (2007). To reflect the findings, the dopamine mod- 
ulation factor |x z for each channel/receptor type z was variable 
in our model. Based on Gruber et al. (2003), the transient was 
modeled as 



^peak, z + (l - ^peak, z) exp ( - — J if ?DA < fpeak 

. V W (ie 

/ t \ / *DA — *peak\ . c * 

1 + (^peak, z - 1) exp I I if t DA > fpeak 

\ ^dec / 



where ?da is the time elapsed since the last dopamine input 
arrived. |x pea k, z is the peak level of |x z and f pea k is the time to reach 
the peak. ii nc and tdec are the time constants in the increasing and 
decreasing phases of |x z , respectively. The peak level |x pea k, z f° r 
each channel/ receptor type is listed in Table 3. The other parame- 
ters were set to t pea k = 60 ms, T mc = 30 ms, and idee = 100 ms. 
Figure 3 shows the typical behaviors of |x z for some types of 
channels or receptors. 



Table 3 | Parameters for dopamine modulation factors. 


Channel z 


^peak, z 


NaF 


0.95 


KIR 


1.25 


Cav1.2 


2.0 


CaN 


0.2 


CaQ 


0.5 


receptor z 


l^peak, z 


NMDA 


1.3 



3. RESULTS 

3.1. VOLTAGE AND CALCIUM RESPONSES: MODEL VALIDATION 

The model parameters were calibrated to fit the electro- 
physiological properties of medium spiny neurons expressing 
Dl-type dopamine receptors, which were examined by whole- 
cell patch clamp experiments in vitro. Figure 4 compares the 
membrane potential responses of the model to those of a 
real neuron. The model replicated the characteristic prop- 
erties of the medium spiny neurons, with a resting mem- 
brane potential around — 85 mV, small voltage responses to 
hyperpolarizing currents, and shallow after-hyperpolarization 



Specifically, the parameter Vhalf for the activation gate variable m of Cavl.3 
channels in Moyer et al. (2007) was varied so that Vhalf = —33 mV in the rest- 



ing state and Vhalf : 
curve as Figure 3. 



-43 mV at the peak. The time course followed the same 



1.5 
3. 1 
0.5 



a 



— M Cav1 .2 
— M NMDA 
^CaQ 




'200 0 



200 400 
Time (msec) 



600 800 



FIGURE 3 | Time courses of dopamine modulation factors. Red, blue 
and green lines indicates |xc av i.2, M^nmda and M^caQ- respectively. The onset 
is the time when the dopamine input arrived. All of the factors reache their 
own peak level in 60 ms, and returns the basal level in 500 ms. 



A so 




B 50 




0 100 200 

Time (msec) 

Model 



100 200 
Time (msec) 

Experiment 



These values were based on Moyer et al. (2007). 



FIGURE 4 | Somatic voltage responses to step current applications. 

(A) Model and (B) experimental responses of medium spiny neurons 
to step current applications from -0.3 nA to 0.28 nA at intervals of 
-0.04 nA. The bars on the horizontal axes indicate the duration of 
current applications. 
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(AHP) following spike firing. In addition, the model repro- 
duced calcium spikes observed in the experimental condition 
during a step current input with the application of 4-AP (potas- 
sium channel blocker) and TTX (O'Donnell and Grace, 1993) 
(Figure 5). 

The voltage and calcium responses to a back-propagating 
postsynaptic action potential (bAP) or a single glutamate input 
were investigated in the spines on proximal and distal den- 
drites of the model neuron. The membrane potential of medium 
spiny neurons with intact cortical input fluctuates between the 
"down-state" of approximately — 85 mV and the "up-state" of 
approximately — 65 mV (Wilson and Kawaguchi, 1996). The up- 
state was simulated by a steady current input of 0.2 nA to 
the soma and the down-state was simulated by no current 
input. 

Figure 6 shows the voltage and calcium responses in the den- 
dritic spines to bAPs, where each postsynaptic action potential 
was evoked by a 2 ms step current application to the soma. 
The bAPs arrived in the spine without delay, but their ampli- 
tudes were attenuated with distance from the soma (Figure 6A). 
Corresponding to the attenuation, the amplitudes of the cal- 
cium responses were also attenuated with distance from the 
soma (Figure 6B). Calcium responses in the up-state were big- 
ger than in the down- state because of greater calcium influx 
through L-type calcium (Cavl.2 and Cavl.3) channels in the up- 
state (Figures 6C,D). However, interestingly, when a wide step 
current (30 ms duration) was applied to evoke an action poten- 
tial, the calcium response was smaller in the up -state than in 
the down-state (Figure 6E), which is consistent with the exper- 
imental result (Carter and Sabatini, 2004). In contrast, when 
T-type calcium channels were blocked, the calcium transients 
evoked by the wide current pulse were larger in the up -state 
than in the down-state. Although calcium currents predomi- 
nantly moved through T-type calcium channels at the moment 
of the current input, T-type calcium channels in the up-state 
were inactivated so rapidly that this inversion phenomenon was 
engendered. 



> 
E 

E 
> 
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FIGURE 5 | Somatic calcium transient reproduced by our model. 

Calcium spikes following a 0.3 nA step current were observed. To mimic 
the application of 4-AP (a potassium channel blocker) and TTX (O'Donnell 
and Grace, 1993), the conductances of KAf, KAs, KRP and NaF channels 
were multiplied by 0.6, 0.4, 0.5 and 0.25, respectively. 



Figure 7 shows the voltage responses (i.e., excitatory postsy- 
naptic potentials; EPSPs) and calcium responses in the dendritic 
spines to a single glutamate input. Here, the inputs were applied 
to the same spines in which the responses were measured. There 
were no significant difference in EPSPs or calcium responses 
between the proximal and distal spines, and the EPSPs and 
calcium responses were greater in the up-state (Figures 7A,B). 
The increased calcium influx in the up -state was mediated 
by voltage-gated calcium channels (CaT and Cavl.3 channels), 
NMDARs, and calcium- dependent calcium release from the ER 
(Figures 7C,D). 

In (Carter and Sabatini, 2004), the following experimen- 
tal findings were reported: (1) The AMPAR-mediated calcium 
response was larger in the down- state than in the up -state dur- 
ing the application of CPP (NMDAR antagonist), TTX (sodium 
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FIGURE 6 | Model prediction of voltage and calcium responses to 
bAP in dendritic spines. (A) Voltage and (B) calcium responses in the 
proximal (solid lines) and distal (dashed lines) dendritic spines to supra 
threshold 2 ms step currents to the soma, which corresponds to the 
experiment that investigated the attenuation of bAP-evoked calcium with 
distance from the soma (Day et al., 2008). The blue lines indicate the 
down-state and the red lines indicate the up-state simulated by the step 
current. (C,D) shows the distribution of the sources of calcium influx to 
the proximal spine in the down- and up-states. (E) Calcium responses in 
the proximal dendric spines to a 30 ms step current to the soma in the 
absence (solid lines) and presence (dashed lines) of T-type calcium 
channel blockade. Again, the red and blue lines indicates the down-state 
and the up-state, respectively. 
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channel blocker), and VDCC blockers; and (2) the NMDAR- 
mediated calcium response was larger in the up -state than in the 
down-state, and it was smaller in the up-state than in the down- 
state in magnesium- free conditions in the presence of NBQX 
(AMPAR antagonist), TTX, and VDCC blockers. We simulated 
the experiments in the following manners: For the Experiment 1), 
we fixed the sodium, calcium, and AMPAR currents in our 
model at zero and measured the calcium responses to glutamate 
input. Similarly, for Experiment 2), we fixed the sodium, calcium, 
and NMDAR currents at zero. Figures 7E,F show the simula- 
tion results, which accurately reproduced the properties reported 
in (Carter and Sabatini, 2004). 

When calcium responses to glutamate input and to bAP 
are compared, glutamate input made a larger response than 
bAP in the proximal spine and smaller responses in the dis- 
tal spine. This amplitude relationship was also observed in the 



experimental study Carter and Sabatini (2004), even though 
a conflicting finding, which glutamate input made a smaller 
response than bAP, has also been reported recently (Shindou 
etal, 2011). 

3.2. TIMING-DEPENDENT CALCIUM RESPONSES TO PAIRED INPUTS 

Using the model, we predicted how the calcium responses depend 
on the relative timing of paired inputs: a presynaptic input 
(either glutamate (Glu) or dopamine (DA)) and a postsynap- 
tic spike (Post). Hereafter, the time difference between Glu 
and Post is denoted by A^gIu where A^gIu > 0 if Glu pre- 
cedes Post. For more intuitive notations, we also use "Glu-Post" 
and "Post-Glu" for A fob > 0 an d A fob < 0, respectively. The 
notational rules are applied to the time difference between DA 
and Post, where the above-mentioned "Glu" are all replaced 
by "DA." 

Figure 8A shows the calcium responses to Glu preceding 
or following Post by 20 ms in the down-state. Figures 8B,C 
shows timing-dependent peak calcium responses as a func- 
tion of AfGlu i n the down- and up-states, respectively. In 
both the up- and down- states, Glu-Post engendered higher cal- 
cium responses than Post-Glu. As for the depencence on the 
location of spines, the amplitude of calcium responses was 
larger in the proximal dendrite than in the distal dendrite, 
but a tendency toward timing dependence was preserved in 
both spines. The effects of DA timing relative to Post on cal- 
cium responses were similar to those of Glu timing: Namely, 
DA-Post engendered a larger calcium response than Post-DA 
(Figures 8D-F). 

The simulation shows sources of calcium influx (Figure 9). 
The increased calcium response to a Glu-Post condition was 
caused by enhanced calcium influx through NMDARs (Figure 9 
upper panels). This is consistent with the calcium imaging exper- 
iment investigating the calcium response to the time difference 
between the glutamate input and bAP (Shindou et al, 2011). 
The simulation results showed that the calcium release from 
ER helps to sustain the long-lasting calcium increase by gluta- 
mate, and emphasizes the difference in the calcium responses 
between Glu-Post and Post-Glu conditions. The increased cal- 
cium response to DA-Post was caused by enhanced calcium influx 
through L-type calcium (Cavl.2 and Cavl.3) channels (Figure 9 
lower panels). 

3.3. TRIPLET INTERACTION 

We then investigated the dependence of calcium responses on 
the timing of triplet inputs: Glu, DA and Post. Figure 10A 
shows the mapping of the temporal order of the triplet inputs 
onto the (A/da, Atciu) -space. Figures 10B-E shows the peak 
calcium concentration in the proximal and distal spines as 
a function of (AfoA, Atciu)- m the both down- and up- 
states, the effects of dopamine inputs were the most prominent 
when DA preceded Post by approximately 60 ms, and ampli- 
fied more when Glu preceded Post. While this tendency was 
also observed in the both proximal and distal spines, the peak 
amplitude was lower in the distal spines than in the proximal 
spines. 
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FIGURE 7 | Model prediction of voltage and calcium responses to 
glutamate input in spines. (A) Voltage and (B) calcium responses in 
proximal (solid lines) and distal (dashed lines) dendritic spines to glutamate 
input. The corresponding experiment was reported in Carter and Sabatini 
(2004), where the the glutamate input was evoked by uncaged glutamate. 
(C,D) shows the distribution of the sources of calcium influx to the proximal 
spine (C) in the down-state and (D) in the up-state. (E) AMPAR-mediated 
calcium signals under the conditions of the sodium, calcium, and NMDAR 
currents being set at zero. (F) NMDAR-mediated calcium responses under 
the conditions of the sodium, calcium, and AMPAR currents being set at 
zero. Glutamatergic synaptic inputs were applied to the same spines in 
which calcium was observed. In (A,B,E,F), the blue lines indicate the 
down-state and the red lines indicate the up-state simulated by a steady 
current input. 
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We then predicted the calcium responses in the proximal 
spines when different synaptic channels were blocked. When L- 
type calcium (Cavl.2 and Cavl.3) channels were blocked, the 
peak amplitude approached that in the distal spines (Figure 1 1A). 



This suggests that the weaker amplitudes in the distal spines were 
caused by insufficiently large bAPs to activate the L-type cal- 
cium channels (Figure 6). The timing dependence of Glu and Post 
was weakened by blocking NMDARs (Figure 11B). The timing 
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FIGURE 8 | Model prediction of timing-dependent calcium responses 
to paired input. (A-C). Calcium responses that depended on the timing of 
glutamate synaptic input (Glu) relative to a postsynaptic spike (Post). (A) 
Typical calcium responses to Glu preceding (solid lines) and following 
(dashed lines) Post by 20 ms. (B,C) Peak of the calcium transient as a 
function of AfQiu (ti me difference between Glu and Post) in the down- and 
up-states, respectively. (D-F) Calcium responses that depended on the 



timing of dopamine synaptic input (DA) relative to Post. (D) Typical calcium 
responses to DA preceding (solid lines) and following (dashed lines) Post 
by 20ms. (E,F) Peak of the calcium transient as a function of AfQiu (fi me 
difference between DA and Post) in the down- and up-states, respectively. 
For all panels, blue and black lines indicate the measurements at the 
proximal and distal dendritic spines, respectively. Post was evoked by a 
2 ms postsynaptic step current. 
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FIGURE 9 | Input-timing-dependent calcium sources predicted by our 
model. Upper and lower panels show the distribution of the sources of 
calcium influx corresponding to Figures 8A,D, respectively. The left 2-by-2 
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dependence of DA and Post was eliminated when both NMDARs 
and L-type calcium channels were blocked (Figure 11C). It is 
noteworthy that the results showed that calcium responses to 
the triplet inputs cannot be explained by just a linear sum of 
DA- and Glu-derived effects. Rather, calcium levels were drasti- 
cally elevated only when both Glu and DA adequately preceded 
Post. The optimal timing to induce the largest calcium response 
was (AfGlu, A^da) = (+50 ms, +60 ms) in the up-state, but it 
shifted to (AtQ\ u , A^da) = (+20 ms, +60 ms) in the down-state 
because of the non-linear interaction between DA- and Glu- 
derived effects. 



where x is the time constant of integration, and a is a scaling fac- 
tor that converts the calcium concentration into the transduction 
signal regulating the synaptic efficacy. We set to x = 600 ms and 
a = 20 and evaluated the peak amplitude of x as a function of 
(At G iu, Af DA ). 

Interestingly, the dependence of the leaky integration x on 
the glutamate and dopamine input timings was different from 
that of the peak calcium concentration (Figure 12A). The tim- 
ing between dopamine and glutamate is more important than 
the timing between glutamate and bAP. The DA timing modu- 
lated the leaky integrator response to Glu- Post bidirectionally: 



3.4. DOPAMINE-MEDIATED MODULATION OF NMDARs 

An uncaging calcium study in the cerebellum reported that 
the amplitude of long-term depression was well predicted from 
a leaky integration of the intracellular calcium concentra- 
tion (Tanaka et al, 2007). The leaky integration x of calcium 
concentration is defined as 
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FIGURE 10 | Model prediction of calcium responses to triplet-timed 
inputs. (A) illustrates the relationship between each value of (Af DA , fciu) 
and the temporal order of triplet inputs: DA; Glu; and Post. For example, the 
timing area 1 (upper-right) indicates that the the temporal order of triplet 
inputs was DA, Glu, Post from the first. The color bar indicates the peak of 
calcium response, which is common for the (B-E) and Figure 3. (B-E). 
Peak calcium concentrations in the proximal spine (B,C) or distal spine 
(D,E) during the down-state (B,D) or the up-state (C,E). 
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FIGURE 11 | Model prediction of calcium responses to triplet-timed 
inputs under blockade conditions. (A) L-type calcium channels (CaL) 
blockade condition where both conductances of Cav1.2 and Cav1.3 
were set to zero. (B) NMDAR blockade condition where conductance 
of NMDAR was set to OpS. (C) Combinations of blockade conditions 
(A) and (B). 
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FIGURE 12 | Leaky integration of calcium responses to triplet-timed 
inputs predicted by our model. (A) The peak amplitude of calcium 
leaky integrator x as a function of (AfGi u > Af DA ), which were 
evaluated in the proximal spines in the up-state. (B) The difference 
between the original model (black lines) and the modified model 
where all DA effects on NMDAR were excluded (red lines). The solid 
and dashed lines indicate the different DA-timings: Af DA = -10ms and 
Af DA = +100 ms, respectively. 
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Glu-Post enhanced x in the DA- Post condition but Post-Glu 
enhanced x in the Post- DA condition. 

To investigate the mechanisms of the DA-timing modula- 
tion, we performed additional simulations where all DA effects 
on NMDAR were blocked (Figure 12B). In this blockade condi- 
tion, Glu-Post did not enhance x even in the DA-Post timing at 
AtpA = +100 ms. Also, the Glu-timing dependence on the leaky 
integrator almost vanished regardless of the DA-timing. 

4. CONCLUSION AND DISCUSSION 

We constructed a multi-compartment model of a medium spiny 
neuron of the striatum based on real morphological data. The 
model could reproduce the major electrophysiological properties 
the neuron and allowed us to predict the calcium responses to 
timed presynaptic inputs (glutamate and dopamine) and a post- 
synaptic spike under various conditions, including the up- and 
down-states. We measured calcium dynamics in both proximal 
and distal spines and evaluated the peak and leaky integration of 
calcium. 

Our major findings are summarized as follows: 

1. Glutamate input preceding a postsynaptic spike induced 
higher calcium responses than glutamate input following a 
postsynaptic spike, which was mediated by NMDARs, L-type 
calcium channels (i.e., Cavl.2 and Cavl.3) and the intracellu- 
lar calcium store (Figures 8, 9). 

2. Dopamine input preceding a postsynaptic spike also induced 
higher calcium responses than dopamine input following a 
postsynaptic spike, which was mediated by L-type calcium 
channels (Figures 8, 9). 

3. Although their amplitudes differed, there was no difference 
in the timing dependence on calcium responses between the 
up- and down-states. At distal spines, the back-propagating 
action potential was attenuated, so that the dopamine tim- 
ing effect was small. Nevertheless, the timing dependence 
on calcium responses between distal and proximal spines is 
preserved. 

4. The timing dependence of the leaky integration of the cal- 
cium was different from that of the peak calcium concen- 
tration. The timing of dopamine input could modulate the 
timing dependency of the glutamate input and postsynaptic 
spike, which was mediated by dopaminergic modulation of 
NMDARs (Figure 12). 

Calcium regulation in synaptic spines plays a key role in the 
synaptic plasticity (Artola and Singer, 1993). In the cortico- 
striatal synapses, dopamine also plays a critical role in induc- 
ing long-term potentiation by increasing cAMP and activating 
PKA in the cells expressing Dl receptors (Nakano et al., 2010). 
Our model shows that dopamine regulates intracellular calcium 
changes, and suggests the possibility that dopamine regulates 
synaptic plasticity through calcium in parallel with the PKA- 
related cascade. In particular, dopamine preceding a postsynaptic 
spike could increase the leaky integration of calcium induced 
by glutamate and a postsynaptic spike, and make it easier to 
potentiate the synaptic efficacy. In addition, our results show 



that application of dopamine before glutamate induces the largest 
calcium responses. 

From the perspective of reinforcement learning theory, 
dopamine is hypothesized to be the reward prediction error signal 
that reinforces the association between the sensory information 
encoded in the glutamatergic input from the cortex and the action 
realized by the striatal spike output. Based on this hypothesis, the 
reinforcement signal should follow the sensory input and action 
output, but our results are inconsistent with this prediction. 
An alternative hypothesis suggests that dopamine codes salience 
rather than reward prediction error (Redgrave and Gurney, 2006; 
Berridge, 2007): The dopamine is released even by unexpected 
sensory events that have no obvious appetitive reinforcement 
consequence (Redgrave and Gurney, 2006), or by novel stimu- 
lations that trigger a motivational state, i.e., "wanting" for the 
reward (Berridge, 2007). According to this scenario, our simula- 
tion results might suggest that the dopamine signal amplifies the 
striatal response (i.e., attention) to the coincident events (includ- 
ing action selection) coded by presynaptic glutamate input, and 
marks the input as biologically significant events. However, the 
effective temporal order of the dopamine-glutamate input in our 
simulation is still inconsistent with this alternative theory, as 
well as with the reinforcement learning theory. Irrespective of 
which hypothesis is correct , this inconsistency suggests that there 
is an unknown network mechanism to overcome these timing 
constraints, or else there is a missing link in the dopaminergic sig- 
naling cascades. A multilevel study integrating calcium dynamics 
and intracellular signal transduction may be critical to elucidating 
these mechanisms. 

Our contribution to the model is the refinement of the pre- 
vious studies (Wolf et al, 2005; Moyer et al, 2007) by incor- 
porating (1) real morphological data; (2) a kinetic model of 
calcium release from intracellular calcium stores; and (3) the 
time variation of the dopamine modulation. It turned out that 
the difference between the presence and the absence of a kinetic 
model of calcium release was significant in the timing effect 
of glutamate and bAP (Figure 9). On the other hand, in this 
study, real morphological data do not makes a significant dif- 
ference in calcium dynamics between these two models with 
the sophisticated and simplified morphology, while morpholog- 
ical variability leads to variability of neural activity in other 
neurons (Mainen and Sejnowski, 1996). The reason would be 
involved in our assumption that the membrane characteristic 
of compartments is homogeneous within each of three den- 
dritic regions (proximal, middle and distal). Such validation is 
out of scope in this study but will be an important issue in the 
future. 

Another important issue to discuss is that there is the other 
type of the medium spiny neurons in the striatum express- 
ing D2-type dopamine receptors, and showing different projec- 
tion and morphology (Gertler et al., 2008). Since it is unclear 
whether the morphological difference is involved in the dif- 
ference of neural activity, our model will serve as a basic 
model for D l-type medium spiny neurons to solve this ques- 
tion. Also, our model excludes a direct mechanism of cal- 
cium buffers, which is known to affect the electrical properties 
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of neurons and other excitable cells as has been reported previ- 
ously Torres et al. (2004); Harks et al. (2003). Another impor- 
tant question is whether such a mechanism affects the neural 
activity in the striatum, though none of the electrophysiological 
experiments compared with our simulation results employed the 
calcium buffer. 



ACKNOWLEDGMENTS 

We thank J. R. Wickens for advice on the morphological trac- 
ing. A part of this study is the result of "Bioinformatics for Brain 
Sciences" carried out under the Strategic Research Program for 
Brain Sciences by the Ministry of Education, Culture, Sports, 
Science and Technology of Japan. 



REFERENCES 

Artola, A., and Singer, W. (1993). 
Long-term depression of excitatory 
synaptic transmission and its rela- 
tionship to long-term potentiation. 
Trends Neurosci. 16, 480-487. doi: 
10.1016/0166-2236(93)90081-V 

Berridge, K. C. (2007). The 
debate over dopamine's role in 
reward: the case for incentive 
salience. Psychopharmacology 191, 
391-431. doi: 10.1007/s00213-006- 
0578-x 

Carter, A. G., and Sabatini, B. L. (2004). 
State-dependent calcium signal- 
ing in dendritic spines of striatal 
medium spiny neurons. Neuron 
44, 483-493. doi: 10. 10 16/j. neuron. 
2004.10.013 

Catterall, W. A. (2000). Structure and 
regulation of voltage-gated Ca2+ 
channels. Annu. Rev. Cell Dev. Biol. 
16, 521-555. doi: 10.1146/annurev. 
cellbio.16.1.521 

Cepeda, C, Colwell, C. S., Itri, J. N., 
Chandler, S. H., and Levine, M. S. 
(1998). Dopaminergic modulation 
of NMDA-induced whole cell 
currents in neostriatal neurons 
in slices: contribution of calcium 
conductances. /. Neurophysiol. 79, 
82-94. 

Charpier, S., and Deniau, J.-M. (1997). 
In vivo activity- dependent plastic- 
ity at cortico-striatal connections: 
evidence for physiological long- 
term potentiation. Proc. Natl. Acad. 
Sci. U.S.A. 94, 7036-7040. doi: 
10.1073/pnas.94.13.7036 

Day, M., Wokosin, D., Plotkin, J. L., 
Tian, X., and Surmeier, D. J. (2008). 
Differential excitability and mod- 
ulation of striatal medium spiny 
neuron dendrites. /. Neurosci. 28, 
11603-11614. 

De Schutter, E., and Smolen, P. (1998). 
Calcium dynamics in large neuronal 
models. Methods Neuron. Model. 6, 
211-250. 

Doya, K. (2002). Metalearning and 
neuromodulation. Neural Netw. 15, 
495-506. doi: 10.1016/S0893-6080 
(02)00044-8 

Falcke, M., Huerta, R., Rabinovich, 
M. L, Abarbanel, H. D., Elson, 
R. C, and Selverston, A. I. (2000). 
Modeling observed chaotic oscil- 
lations in bursting neurons: the 
role of calcium dynamics and IP3. 



Biol. Cybern. 82, 517-527. doi: 
10.1007/s004220050604 

Fino, E., Glowinski, J., and Venance, 
L. (2005). Bidirectional activity- 
dependent plasticity at corticostri- 
atal synapses. /. Neurosci. 25, 1 1279- 
11287. doi: 10.1523/JNEUROSCI. 
4476-05.2005 

Geit, W. V., Achard, P., and Schutter, 
E. D. (2007). Neurofitter: a param- 
eter tuning package for a wide 
range of electrophysiological neu- 
ron models. Front. Neuroinformatics 
1:1. doi: 10.3389/neuro.l 1.001.2007 

Gertler, T. S., Chan, C. S., and Surmeier, 
D. J. (2008). Dichotomous anatom- 
ical properties of adult striatal 
medium spiny neurons. /. Neurosci. 
28, 10814-10824. doi: 10.1523/ 
JNEUROSCI.2660-08.2008 

Gong, S., Zheng, C, Doughty, M. L., 
Losos, K., Didkovsky, N., Schambra, 
U. B., et al. (2003). A gene expres- 
sion atlas of the central nervous 
system based on bacterial arti- 
ficial chromosomes. Nature 425, 
917-925. doi: 10.1038/nature02033 

Gruber, A. J., Solla, S. A., Surmeier, 
D. J., and Houk, J. C. (2003). 
Modulation of striatal single units 
by expected reward: a spiny neuron 
model displaying dopamine- 
induced bistability. /. Neurophysiol. 
90, 1095-1114. doi: 10.1152/jn. 
00618.2002 

Harks, E. G. A., Torres, J. J., Cornelisse, 
L. N., Ypey, D. L., and Theuvenet, A. 
P. R. (2003). Ionic basis for excitabil- 
ity of normal rat kidney (NRK) 
fibroblasts. /. Cell. Physiol. 196, 493- 
503. doi: 10. 1002/jcp. 10346 

Hernandez-Lopez, S., Bargas, J., 
Surmeier, D. J., Reyes, A., and 
Galarraga, E. (1997). Dl receptor 
activation enhances evoked dis- 
charge in neostriatal medium spiny 
neurons by modulating an L-type 
Ca2+ conductance. /. Neurosci. 17, 
3334-3342. 

Hines, M. L., and Carnevale, N. T. 
(2001). NEURON: a tool for neuro- 
scientists. Neuro scientist 7, 123-135. 
doi: 10.1177/107385840100700207 

Holmes, W. R. (1989). The role 
of dendritic diameters in max- 
imizing the effectiveness of 
synaptic inputs. Brain Res. 478, 
127-137. doi: 10.1016/0006-8993 
(89)91484-4 



Johnson, B. R., Kloppenburg, P., and 
Harris- Warrick, R. M. (2003). 
Dopamine modulation of calcium 
currents in pyloric neurons of the 
lobster stomatogastric ganglion. 
/. Neurophysiol. 90, 631-643. doi: 
10.1152/jn.00037.2003 

Kampa, B. M., Letzkus, J. J., and Stuart, 
G. J. (2007). Dendritic mechanisms 
controlling spike - timing- dependent 
synaptic plasticity. Trends Neurosci. 
30, 456-463. doi: 10.1016/j.tins. 
2007.06.010 

Koch, C. (1998). Biophysics of 
Computation: Information 
Processing in Single Neurons. 
New York, NY: Oxford University 
Press. 

Mainen, Z. E, and Sejnowski, T. }. 
(1996). Influence of dendritic struc- 
ture on firing pattern in model 
neocortical neurons. Nature 382, 
363-366. doi: 10.1038/382363a0 

Moyer, J. T., Wolf, J. A., and Finkel, 
L. H. (2007). Effects of dopaminer- 
gic modulation on the integrative 
properties of the ventral stri- 
atal medium spiny neuron. /. 
Neurophysiol. 98, 3731-3748. 

Nakano, T., Doi, T., Yoshimoto, J., 
and Doya, K. (2010). A kinetic 
model of dopamine- and calcium - 
dependent striatal synaptic plastic- 
ity. PLoS Comput. Biol. 6:e 1000670. 
doi: 10.1371/journal.pcbi.l000670 

Nicola, S. M., Surmeier, D. J., 
and Malenka, R. C. (2000). 
Dopaminergic modulation of 
neuronal excitability in the striatum 
and nucleus accumbens. Annu. 
Rev. Neurosci. 23, 185-215. doi: 
10.1 146/annurev.neuro.23. 1 .185 

O'Donnell, P., and Grace, A. A. (1993). 
Physiological and morphological 
properties of accumbens core and 
shell neurons recorded in vitro. 
Synapse 13, 135-160. doi: 10.1002/ 
syn.890 130206 

Pawlak, V., and Kerr, J. N. D. (2008). 
Dopamine receptor activation 
is required for corticostriatal 
spike-timing-dependent plasticity. 
/. Neurosci. 28, 2435-2446. doi: 
10.1523/JNEUROSCI.4402-07.2008 

Redgrave, P., and Gurney, K. (2006). 
The short-latency dopamine signal: 
a role in discovering novel actions? 
Nat. Rev. Neurosci. 7, 967-975. doi: 
10.1038/nrn2022 



Reynolds, J. N., Hyland, B. I., and 
Wickens, J. R. (2001). A cellu- 
lar mechanism of reward-related 
learning. Nature 413, 67-70. doi: 
10.1038/35092560 

Shen, W, Flajolet, M., Greengard, 
P., and Surmeier, D. J. (2008). 
Dichotomous dopaminergic control 
of striatal synaptic plasticity. Science 
321, 848-851. doi: 10.1126/science. 
1160575 

Shindou, T., Ochi-Shindou, M., and 
Wickens, J. R. (2011). A Ca(2+) 
threshold for induction of spike- 
timing-dependent depression in 
the mouse striatum. /. Neurosci. 
31, 13015-13022. doi: 10.1523/ 
JNEUROSCI.3206-11.2011 

Smith, A. D., and Bolam, J. P. (1990). 
The neural network of the basal 
ganglia as revealed by the study 
of synaptic connections of identi- 
fied neurones. Trends Neurosci. 13, 
259-265. doi: 10.1016/0166-2236 
(90)90106-K 

Steephen, J. E. (2011). Excitability 
range of medium spiny neurons 
widens through the combined 
effects of inward rectifying 
potassium current inactivation 
and dopaminergic modulation. 
Neurocomputing 74, 3884-3897. 
doi: 10.1016/j.neucom.2011.08.003 

Surmeier, D. J., Bargas, J., Hemmings, 
H. C, Nairn, A. C, and Greengard, 
P. (1995). Modulation of calcium 
currents by a Dl dopaminergic 
protein kinase/phosphatase cascade 
in rat neostriatal neurons. Neuron 
14, 385-397. doi: 10.1016/0896- 
6273(95)90294-5 

Surmeier, D. J., Ding, J., Day, M., Wang, 
Z., and Shen, W. (2007). Dl and 
D2 dopamine-receptor modulation 
of striatal glutamatergic signaling 
in striatal medium spiny neurons. 
Trends Neurosci. 30, 228-235. doi: 
10.1016/j.tins.2007.03.008 

Tanaka, K., Khiroug, L., Santamaria, 
E, Doi, T., Ogasawara, H., Ellis- 
Davies, G. C. R., et al. (2007). 
Ca2+ requirements for cerebellar 
long-term synaptic depression: role 
for a postsynaptic leaky integrator. 
Neuron 54, 787-800. doi: 10. 10 16/j. 
neuron.2007.05.014 

Torres, J. J., Cornelisse, L. N., Harks, 
E. G. A., Van Meerwijk, W. P. M., 
Theuvenet, A. P. R., and Ypey, D. L. 



Frontiers in Computational Neuroscience 



w w w.f ro ntiersin.org 



September 2013 | Volume 7 | Article 119 | 11 



Nakano et al. 



Striatal calcium response to timed-inputs 



(2004). Modeling action poten- 
tial generation and propagation in 
NRK fibroblasts. Am. J. Physiol. Cell 
Physiol. 287, C851-C865. 
Varona, P., Torres, J. J., Abarbanel, 
H. D., Rabinovich, M. L, and 
Elson, R. C. (2001a). Dynamics 
of two electrically coupled chaotic 
neurons: experimental observations 
and model analysis. Biol. Cybern. 84, 
91-101. 

Varona, R, Torres, J. J., Huerta, R., 
Abarbanel, H. D., and Rabinovich, 
M. I. (2001b). Regularization mech- 
anisms of spiking-bursting neurons. 
Neural Netw. 14, 865-875. 

Wilson, C. J., and Kawaguchi, Y. (1996). 
The origins of two-state sponta- 
neous membrane potential fluctua- 
tions of neostriatal spiny neurons. /. 
Neurosci. 16, 2397-2410. 



Wolf, J. A., Moyer, J. T., Lazarewicz, 
M. T., Contreras, D., Benoit- 
Marand, M., O'Donnell, R, and 
Finkel, L. H. (2005). NMDA/AMPA 
ratio impacts state transitions 
and entrainment to oscillations 
in a computational model of the 
nucleus accumbens medium spiny 
projection neuron. /. Neurosci. 
25, 9080-9095. doi: 10.1523/ 
JNEUROSCI.2220-05.2005 

Yang, C. R., and Seamans, J. K. 
(1996). Dopamine Dl receptor 
actions in layers V-VI rat pre- 
frontal cortex neurons in vitro: 
modulation of dendritic-somatic 
signal integration. /. Neurosci. 16, 
1922-1935. 

Zhou, W.-L., and Antic, S. D. 
(2012). Rapid dopaminergic and 
GABAergic modulation of calcium 



and voltage transients in dendrites 
of prefrontal cortex pyramidal 
neurons. /. Physiol. 590(Pt 16), 
3891-3911. doi: 10.1113/jphysiol. 
2011.227157 



Conflict of Interest Statement: The 

authors declare that the research 
was conducted in the absence of any 
commercial or financial relationships 
that could be construed as a potential 
conflict of interest. 



Received: 28 May 2013; accepted: 09 
August 2013; published online: 13 
September 2013. 

Citation: Nakano T, Yoshimoto } and 
Doya K (2013) A model-based predic- 
tion of the calcium responses in the 



striatal synaptic spines depending on 
the timing of cortical and dopaminergic 
inputs and postsynaptic spikes. Front. 
Comput. Neurosci. 7:119. doi: 10.3389/ 
fncom.2013. 00119 

This article was submitted to the 
journal Frontiers in Computational 
Neuroscience. 

Copyright © 2013 Nakano, Yoshimoto 
and Doya. This is an open-access arti- 
cle distributed under the terms of the 
Creative Commons Attribution License 
(CC BY). The use, distribution or repro- 
duction in other forums is permitted, 
provided the original author (s) or licen- 
sor are credited and that the original 
publication in this journal is cited, in 
accordance with accepted academic prac- 
tice. No use, distribution or reproduction 
is permitted which does not comply with 
these terms. 



Frontiers in Computational Neuroscience 



www.frontiersin.org 



September 2013 | Volume 7 | Article 119 | 12 



